BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on Regulation events by Approx. Span & Recur. matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ConcordU ]         Regulation           291 (   70)      153 (   70)    24.05    45.75    31.53
[JULIELab ]         Regulation           291 (   91)      302 (   91)    31.27    30.13    30.69
[ UTurku  ]         Regulation           291 (   74)      194 (   74)    25.43    38.14    30.52
[UT+DBCLS ]         Regulation           291 (   69)      169 (   69)    23.71    40.83    30.00
[ UTokyo  ]         Regulation           291 (   33)       78 (   33)    11.34    42.31    17.89
[ UZurich ]         Regulation           291 (   34)      120 (   34)    11.68    28.33    16.55
[  UNSW   ]         Regulation           291 (   36)      161 (   36)    12.37    22.36    15.93
[   Cam   ]         Regulation           291 (   27)       74 (   27)     9.28    36.49    14.79
[VIBGhent ]         Regulation           291 (   31)      136 (   31)    10.65    22.79    14.52
[  NICTA  ]         Regulation           291 (   43)      339 (   43)    14.78    12.68    13.65
[UAntwerp ]         Regulation           291 (   26)      110 (   26)     8.93    23.64    12.97
[ Team 24 ]         Regulation           291 (   22)       92 (   22)     7.56    23.91    11.49
[ UAveiro ]         Regulation           291 (   23)      165 (   23)     7.90    13.94    10.09
[  SCAI   ]         Regulation           291 (   28)      280 (   28)     9.62    10.00     9.81
[ USzeged ]         Regulation           291 (   15)       65 (   15)     5.15    23.08     8.43
[CIPS-ASU ]         Regulation           291 (   33)      521 (   33)    11.34     6.33     8.13
[CNBMadrid]         Regulation           291 (   30)      555 (   30)    10.31     5.41     7.09
[CCP-BTMG ]         Regulation           291 (    9)       19 (    9)     3.09    47.37     5.81
[ UNIMAN  ]         Regulation           291 (    9)       47 (    9)     3.09    19.15     5.33
[  UMich  ]         Regulation           291 (    9)      235 (    9)     3.09     3.83     3.42
[  PIKB   ]         Regulation           291 (    5)       15 (    5)     1.72    33.33     3.27
[ KoreaU  ]         Regulation           291 (    2)       12 (    2)     0.69    16.67     1.32
[ASU+HU+BU]         Regulation           291 (    1)       13 (    1)     0.34     7.69     0.66
[ Team 09 ]         Regulation           291 (    0)        0 (    0)     0.00     0.00     0.00

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ]         Regulation           292 (   65)      169 (   65)    22.26    38.46    28.20
[UAntwerp ]         Regulation           292 (   25)      110 (   25)     8.56    22.73    12.44
[ Team 24 ]         Regulation           292 (   22)       94 (   22)     7.53    23.40    11.40
[CNBMadrid]         Regulation           292 (   25)      555 (   25)     8.56     4.50     5.90
[CCP-BTMG ]         Regulation           292 (    9)       19 (    9)     3.08    47.37     5.79
[ASU+HU+BU]         Regulation           292 (    1)       13 (    1)     0.34     7.69     0.66

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------